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Abstract 

Highly correlated brain dynamics produces synchronized states with no behavioral value, 
while weakly correlated dynamics prevents information flow. We discuss the idea put for- 
ward by Per Bak that the working brain stays at an intermediate (critical) regime character- 
ized by power-law correlations. 

Key words: self-organized criticality, brain, networks 
PACS: 87.18.Sn, 87.19.La, 89.75.Da, 89.75.Hc 



1 Introduction 



The human brain is a large system, with no more than a hundred specialized mod- 
ules with different functions. At the smallest grain, the cerebral cortex consists of 
about 10^^ neurons that comprise a highly interconnected network. Each cell re- 
ceives continuously a few thousands of excitatory inputs from other neurons. One 
of the simplest things we do not know about the brain is how the cortex, being a 
mainly excitatory network, prevents the expected explosive propagation of activ- 
ity and still transmits information across areas. If the average number of neurons 
activated by one neuron is too high (i.e., supercritical) this results in the massive 
activation of the entire network, while if it is too low (i.e., subcritical), propagation 
dies out. The critical regime is the one in which these opposing processes are bal- 
anced. It was Turing, about fifty years ago [1], the first to speculate in these terms. 
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arguing that brains should be at a barely critical state. We review here the proposal 
[2] that most behaviorally relevant brain states, are associated with dynamics which 
is critical in this sense. This perspective places the emphasis on understanding the 
brain's large number of dynamical nonlinear degrees of freedom, and in the dynam- 
ical attractors that are expected to emerge from the interaction of these elements. 
Less emphasis is given to some other aspects, including probable "computation" 
properties of the emergent circuits. In a loose sense it claims that what we see as 
a brain is all what it can be expected as the obligatory solutions of putting these 
degrees of freedom to interact with each other. It says nothing about anything else. 

The paper is dedicated to discuss recent experimental findings of critical correla- 
tions in brain dynamics. The paper is organized as follows. The next section re- 
minds ourselves where the brain problem is in the general context of dynamical 
systems. In section 3 we discuss results from brain imaging experiments showing 
a broad distribution of functional connectivity, implying that brain networks are 
scale-free. This is contrasted with the known cortical connectivity. Section 4 con- 
tains recent experimental evidence at the in vitro level indicating that cultured corti- 
cal networks are critical at the neuronal level. The paper concludes with a comment 
on the ideas of our late friend Per, who foresaw many of these results. 



2 Brains in "Dynamicsland". 

Brain activity happens in bursts, in which pauses, silence or boredom suddenly and 
unpredictably are followed by brief activity. From a dynamical viewpoint brain dy- 
namics is not different from other natural processes. Nature is clearly non homoge- 
neous and intermittent, the analysis of any natural object reveals an ever surprising 
amount of details; there is no single relevant scale at which Nature becomes ho- 
mogeneous. Complexity is this lack of uniformity associated with the scale-free 
spatiotemporal feature. The driving force in this field continues to be the effort to 
understand what generates complexity, and how many different dynamical mech- 
anisms can produce scale-free objects. It is now widely recognized that, under a 



Complicated 
Systems 


many linear pieces + a central supervisor + blueprint 
= "whole" (Example: tv set) 


Complex 
Systems 


many nonlinear pieces + coupling + injected energy 
= "emergent properties" (Example: society) 



Table 1 

Complicated systems are not complex. 

variety of conditions, non linear systems with many degrees of freedom tend to 
evolve towards complexity and criticality [2,3]. It is the interaction of many non- 
linear degrees of freedom which produces emergent dynamics we call complex. 
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The latest "heavenly example" is the sun's sudden bursts of radiation emanating 
from quick re- arrangements of the magnetic field network in the corona [4]. This is 
different from the dynamics arising in complicated systems comprised of the sim- 
ple addition of interconnected linear pieces (Table 1). Examples of complicated 
systems are a television set, or a car. They do not "emerge", they are manufactured 
by following a blueprint given by the designer. Evolution to more complicated de- 
signs requires always of the supervisor (or designer) intervention. Complex systems 
such as species, ecologies, societies or brains do not arise from blueprints, they are 
very robust emergent consequences of dynamical laws we still do not understand. 
We can not replay the tape of evolution to investigate whether other ecologies will 
arise or self-organize, but in the case of brains we witness the high percentage of 
brains that end up well connected and, with few exceptions, working. This is a 
marvellous thing, considering that during one year of development a brain is con- 
tinuously adding (or "connecting") 10^ news neurons per minute. What are the 
basis of the self-organizing mechanism able to achieve such feats? One motivation 
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Fig. 1. "DynamicsLand": A cartoonish representation of the parameter space for various 
classes of dynamical systems. The simplest ones "live" in the left bottom corner, where 
analysis and formal proofs are the techniques expected, but many fundamental problems 
in biology correspond to areas distant from that land. Relatively simple dynamics gets 
sophisticated as the nonlinear term acquires relevance (moving upward in the graph) or 
as the number of degrees of freedom increases (moving to the right). Pictorial examples 
include: (1) the transition from one to many coupled pendulums, (2) few foraging ants to 
the entire swarm [5], (3) from the chaotic dynamics of an isolated cardiac cell [6] to the 
spatiotemporal spiral waves in the heart [7], (4) a sandpile and, of course, (5) the brain. 

for biologists to look at the physical laws governing complex systems of all kinds 
is the hope that universality will give us an edge. The rationale is that a good un- 



3 



derstanding of these universal laws will provide a breakthrough and shed light on 
related biological problems. The considerations in the cartoon of Figure 1 remind 
us that the brain is at a region of parameter space where complex dynamics can 
emerge. In that top-right corner, theory is scarce, but some insight and numerical 
tools can be borrowed from related work in self-organized criticality and complex 
networks, as discussed in the next section. 



3 Functional networks are scale-free. 



Brain activity is eminently spatio-temporal, as such the monitoring of the com- 
plicated cortical patterns have greatly benefited from techniques developed in the 
context of functional magnetic resonance imaging (fMRI). However, the numerical 
analysis of such spatiotemporal patterns is less developed, lacking mathematical 
tools and approaches specifically tailored to grasp the complexity of brain cortical 
activity. One possibility is to get insight from recent work showing that disparate 
systems can be described as complex networks, that is assemblies of nodes and 
links with nontrivial topological properties [8,9,10]. 

The brain creates and reshapes continuously complex functional networks of corre- 
lated dynamics responding to the traffic between regions, during behavior or even at 
rest. We have recently studied these networks, using functional magnetic resonance 
imaging in humans (see methods in [15]. The data is analyzed in the context of 
the current understanding of complex networks (for reviews see [8,9,10,1 1,12,13]). 
During any given task the networks are constructed in the following way. Magnetic 
resonance brain activity is measured, at each time step (typically 400 spaced 2.5 
sec), from 36 x 64 x 64 brain sites (so-called "voxels" of dimension 3 x 3.475 x 
3.475 mm^). The activity of voxel x at time t is denoted as V{x^t). To define the 
links, we denote as functionally connected those brain sites whose temporal evo- 
lution are correlated beyond a positive pre-established value r^, following an ap- 
proach used previously in [14]. (Networks can be built as well by defining negative 
or positive correlations). Specifically, we calculate the linear correlation coefficient 
between any pair of voxels, xi and X2, as: 

.. ^ _ {V(xi,t)V(x2,t)) - (V(xi.t))(Vfe,0) 



where a^{y{x)) = (y(x,^)^) — (y(x,^))^, and (•) represent temporal averages. 

In Fig. 2, we show a typical network extracted with this technique for one subject 
in a finger tapping task [15]. The top panel shows the network's nodes (only a por- 
tion for illustration) colored according to its degree and the bottom panel the degree 
distribution of the network. Degree is the mathematical term for each voxel connec- 
tivity, being represented here as how many other voxels are temporally correlated 
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Fig. 2. A typical brain network extracted from functional magnetic resonance imaging. Top 
panel shows a pictorial representation of the network where the nodes are colored according 
to its degree: yellow = 1, green = 2, red = 3, blue=4, etc. The bottom panel shows the degree 
distribution for two correlation thresholds. The inset depicts the degree distribution for an 
equivalent randomly connected network. Data re-plotted from [15]. 

with it. We find that the degree distribution has a skewed distribution with a tail 
approaching a power law distribution with an exponent around 2. As the threshold 
rc is decreased a maximum appears which shifts to the right as is lowered. Other 
measures reveal that the number of links as a function of distance also decays as a 
power law. This is so, from one voxel, the smallest scale able to be measured with 
this technique, to the largest, the size of the brain. When we looked how the connec- 
tivity was arranged in the neighborhood of a node we found that highly connected 
nodes were connected, on the average, with highly connected ones. This feature, 
only seen before in social networks is inverse to what one expects from a hierarchi- 
cal organization [16,17,18]. We looked at two other statistical properties of these 
networks, path length and clustering. The path length (L) between two voxels is the 
minimum number of links necessary to connect both voxels. Clustering (C) is the 
fraction of connections between the topological neighbors of a voxel with respect 
to the maximum possible. If voxel / has degree then the maximum number of 
links between the ki neighbors is ki{ki — l)/2. Thus, if Ei is the number of links 
connecting the neighbors then the clustering of voxel /, Q = 2Ei/ki{ki — 1). The 
average clustering of a network is given by C = 1 /NY^iQ, where N is the number 
of voxels. The results are presented in Table 2 (average values for n = 22 datasets, 
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4891 


0.15 


6. 


4.12 


2.2 


8.9x10-4 
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Macaque C.C. 


71 


0.46 


2.3 


10.6 


NA 


0.15 


2.0 



Table 2 

Statistical properties of human fMRI functional networks [15] and macaque cerebral cortex 
connectivity [21]. 



Vc = 0.8). From left to right are listed N, (number of nodes) C (clustering coef- 
ficient), L (shortest path length), the average degree <k>, and X the exponent 
of the degree distribution. The clustering {Grand) ^i^d path length (Lrand) values of 
an equivalent random network are also included for comparison. In all cases, the 
coefficient C remains four orders of magnitude larger than Crand^ the clustering of 
a random network. This feature, together with the similarity of path length of the 
original network and their randomized controls (L and L^and)^ is indicative of a 
small-world structure. 



In this approach we define two voxels as "linked" if they are temporally correlated 
beyond some value. This, of course, does not mean they are mutually connected (via 
chemical or neuro-transmitter or anatomical paths). The simplest counter-example 
is the case of a common input activating both sites. Further analysis will clarify 
if this is the case for the networks we are studying. In this regard it is relevant to 
look at work done over the last decade on the cortical connectivity (now "linked" is 
used in the strong sense of being mutually connected) by Spoms et al. [19,20,21], 
Hilgetag et al. [22], Young et al. [23] and Scannel et al. [24]. The analysis of con- 
nectivity matrix of these data sets reveals that although the networks are highly 
clustered and exhibit relatively short path lengths (see Table 2) as in small world 
networks, they exhibit a rather homogeneous degree distribution. In Figure 3 the 
macaque cerebral cortex connectivity matrix [23] is plotted in the top panel. Be- 
cause of the small statistics (only 71 nodes), its degree distribution is computed 
as the cumulative density, plotted in the bottom panel of the same figure. It can be 
seen that the degree distribution is not a power law, instead one sees that no area has 
less than four links and that the majority are linked with about ten other areas. The 
scale-free features illustrated in Fig. 2 reflects underlying long range correlations, 
i.e., brain activity on a given area can be correlated with far away and apparently 
unrelated regions, something already documented with other technology [25]. In 
qualitative terms this means that, for instance, a concurrent sound or simply im- 
agery can influence thoughts or pain perception. Using the network approach here 
described, various dynamical brain behavioral states can be studied in the future. 
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Fig. 3. Top panel: Connectivity matrix of the macaque cortex [23]. A black square de- 
notes a connection between the 71 cortical areas: VI, V2, V3, VP, V3A, V4, VOT, V4T, 
MT, MSTD, MSTL, FST, PITD, PITV, CITD, CITV, AITD, AITV, STPP, STPA, TP, 
TH, PO, PIP, LIP, VIP, DP, ATA, FEF, A46, TGV, ER, HIPP, A3A, A3B, Al, A2, A5, 
Rl, S2, A7B, IG, ID, A35, A4, A6, SMA, A3, A23, A24, A9, A32, A25, AlO, A45, 
A12, All, A13, G, PAAR, PAAL, PAAC, KA, PAL, PROA, REIT, TGD, TSl, TS2, 
TS3, TPT (top to bottom, left to right). For reference are labelled visual (VI), enthori- 
nal (ER) and temporoparietal (TPT) cortices. Bottom panel: Cumulative degree distribu- 
tion for the same data in the top panel. In contrast with the data plotted in Fig.2, here 
there is no scale-free connectivity. Matrix data from Ref. [21] (available from website 
|http:7/w ww.india na.edu/^cortex7connectivity] ). 

4 Neuronal avalanches are critical. 

What are the neuronal mechanisms responsible for the correlations described in 
the previous section? From a top-down approach, Varela was among the first to 
be concerned with the brain large scale dynamical properties (reviewed in Ref. 
[26]). Varela assumed that "For every cognitive act, there is a singular and spe- 
cific large cell assembly that underlies its emergence and operation" [27]. Efforts 
are underway to formulate in neuronal terms this working hypothesis, also termed 
"dynamic core" [28]. Other bottom-up complementary, approaches involve sophis- 
ticated recording in cortical structures with multielectrode arrays (see a review in 
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[29]). A recent study [30] deserves special mention, because it provides quanti- 
tative estimations of the dynamical properties and characteristic exponents open- 
ing the possibility to model the neural mechanisms. Beggs and Plenz [30] studied 
the spontaneous neuronal activity of cultured and acute slices of rat cortex using 
60-channel multielectrode arrays. They documented that during spontaneous activ- 
ity the cortex typical activity shows intermittent avalanches. After computing the 
statistics of several days worth of continuous cortical activity with a few millions 
of events, they showed that the avalanche size distributions, expressed as total num- 
ber of electrodes activated per run, demonstrates the existence of a power law, with 
exponent a ^ 1.5 as shown in Fig. 4. They also computed an average branching 
activation ratio close to unity (calculated as the ratio between the current and future 
number of excited electrodes). The authors showed that this branching ratio op- 
timizes information transmission in feedforward networks models. These aspects 
demonstrating criticality should be quantitatively accounted for by futures theories 
of cortical dynamics. 



P 




size (#electrodes) 



Fig. 4. The size distribution of neuronal avalanches in mature cortical cultured networks 
follows a power law with an exponent ^3/2 (dashed line). The data, re-plotted from Figure 
4 of [30], shows the probability of observing an avalanche covering a given number of 
electrodes for three sets of grid sizes shown in the insets with n=15, 30 or 60 sensing 
electrodes (equally spaced at 200/im). The statistics is taken from data collected from 7 
cultures in recordings lasting a total of 70 hours and accumulating 58000 (H — 55000) 
avalanches per hour (mean H — SD). 



5 Per foresaw it. 



"Is biology too difficult for biologists? And what can physics, dealing with the 
simple and lawful, contribute to biology, which deals with the complex and di- 
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verse?". In such challenging terms Per Bak encouraged colleagues to look at bi- 
ology. Much before mainstream physics embraced biology, Per Bak was already 
convinced that "The big targets for physics theorists are biological evolution and 
the brain. These complex many-body problems might have similarities to problems 
studied in particle- and solid-state physics." [31]. In an attempt to shake the stagnat- 
ing state of these fields, by way of models and provocative metaphora, he suggested 
useful ways to re-think the most important issues in these areas. At the same time, 
he often insisted, in his unforgiving way, that mainstream ideas about neural mod- 
els were an "example of physicists leading a whole field astray", because it was 
"hard to imagine a biological foundation for the complicated procedures for updat- 
ing the synaptic strengths in those models" [31]. It was fun, in a way, to witness 
him, a physicist, reminding biologists and everybody else about the biological un- 
plausibility of current brain models and the need to reconsider the constraints of 
self-organization as designing principle [32,33,34,35]. In his opinion, it was ab- 
solutely obvious that self-organization is the driving mechanism designing Nature 
around us, regardless if it was a human society, millions of neurons or an ant swarm. 
It is, in this view, mandatory to understand first the general laws before attempting 
to proceed with anything else. Per used to joke that, working out the further details 
will be just as easy (and boring) as the "cleaning after the party" . It is fascinating to 
see that a decade later, self-organization issues are newsworthy even to engineering 
[36]. 
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